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(54) IMAGE SYNTHESIS DEVICE AND METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To make joints of images 
unremarkable in the case that a plurality of images 
whose exposure differs and whose parts are picked up 
overappingly are connected to obtain one panorama 
image. 

SOLUTION: A cross reference point extract section 1 
detects cross reference points of two input images a, b, 
a parameter estimate section 2 estimates a parameter 
to made coordinate transformation of the extracted 
cross reference points and a gradation correction 
coefficient decision section 3 obtains a coefficient to 
weight the images a, b based on the estimated 
parameter. Gradation correction control sections 4, 5 
correct duplicate parts of at least either of the images a, 
b. An image synthesis conversion section 6 weights at 
least either of the images a t b and adds the result to the 
original image and synthesizes the sum image and the 
other image based on the parameter. 
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*«K »2flE)Hlfca)*< i:t-**»jE-r-B»iE*« 

±E»iES*Lfc*1 . «2<DB«G>'> 

M-lt LT5£®B«£:ft]«:U C<DJnWB«£te*<BB« 

x.fcBft£i££B. 

i E«a>B«&/aa£So 

EttOBtt^JftgK. 

i. *2 0H«a>#3pj^(B(Z)si=at^LxTJtffinifffi(Dia 

Sic 

1, K2<DB«<Dd>< £:i-#£*iiEU MIE^tufcm 
K £2<DBfft<Dd>< <t ti-#*S^f*ItLT5cfl>B« 
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[0 0 0 3] 
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f^lftl7U-Af 1 . f 2<Dftrt-e»«Lfc»*Sffl 
<7>B*a(i^Bf3&<MS<<C*«fc5»IE**i-C. B01 7 

[0004] aot, xwasna* ±isnijatiRft 

g 11 fc u cfc 5 1 = B fit £ # 4 - <t -c? # B ft^-fli 

ss^o ct saet-r s - <t t fe * „ 

[0 0 0 5] 

ob<£ <t z.d>% i oba «t ii«p # £?rr 4 k 2 g>b« 

t . ±E*5e Lfc/\°5 > — * (=»-JL^r -hE»«»»l=: 
*2 0>B*G>*i>< £*-*£»jE-r*«IE 
^St, ±E«iE**ifcSS 1 . «2(DH«0>il>< 

*<DBfci *±E'<^ > — * (=»^l^r 
[000 6] " 

<DB«**IjEU c-(D«jES*tfcB«£«^ftl+Lfc 
ft. *(D7c(DB*fti:ai»:L. cfl>*D«**ifcB«i:fb* 
<DB^<t £-tE/^ y — * i::»-5^T-3 - 
irlCcfcU 1 1*<Z)#jaB«*<»&*t*o 
[0007] 

[«Bfl(DSJfea>^ffi] HI 1 (c^^B^CDm 1 CO||J£0>ff<?S 

a. bf=^Lfc«fc5 3fe»«ft<Z>B*ftfr(D*3S§B«T? 
fe^o 1 l±»f&j£«ttiffl-e&y , A*B«a. bfpKDiij 

[ooos] 3ttPRM*iEfiiCkftS«'efty. a*b« 

^^^$*^-r^o 4. 5i*BB«E»»-c?a&y. 
^tLA^ii^a, biz^txmmmiE^^i\ 2 now 
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ft::**-*-*. 7(»flldAttlB±»(Dffl»«fr5«l«i 
[0 0 0 9] *l-A*HMfca. b*^b#JjlH»cS±Jilt 
a. beDHfft^— 

yttJL««t-rSo ^^T?l*H 1 7<7)cfc3(=:A*IHflii 
a. b(4£. ^<DBKlcSfeA/-eL^*<Otf. El 3 <7>£ 5 (c % 

*. . ■* it commit £ #«g Lfc^a ^m^xmrnv- 
-fxa>-ifijaj»a)*:#*fl!>/Mi«t *«yttrt- 0 ca> 

14. H«aO)Slt*iRi<DTai^6 3»], 7K¥*|RJ(D1*J 20 

A^9#]*iH«aicte(+a7->^u— nay tii L««i 

T5t«fc^. *lcx-r^^S 2 2t?«ytBLfc±5 1 >^ 
U— McoivCJsTFG^T-^S 23-S2 5(&flL3i£ 

[OOlO]Xf*;?S2 3X*l£tj)i)ftLt^>yis— 

**e>± i »j©ffiiB*a3Rffl«sfr-6o ^commm^it so 

A*B«a. -bO)K«««*<7K¥*lS]-e5 9JJ£lT-(?. S* 

xb= ( c o s 0 * x a -h s i n 0 1 
= A ■ xa+B ■ ya+C 

yb= (— s i n 6 ■ x a + c o s< 0 
= — B • x a + A • y a + D 

11 U 

A = m • c o s 0 N B = m • s i n 6 
[0 0 15] C<DB#(D/\'^y— £ A. B N C. D 

s*ai=«fcy/^^— ^*5e«2T?«iffi-r*o si. 40 

A=1. B = 0. C = — a x . D = - 
[0 0 16] *fc. »l£ji5*<l WtiScSfeft^ofc*^- 

4E S- ^ ;1J -t S IB I ~ ffl I* b *t 6 ■ 

[0017] -?5. mm$l&® 4 , 5 T*(4**L-?*tA* 
EHfta* b(=#LTBBSfc«£frL\ 2-3<Z>BHft(DB« 



*H*lo)-t?l4± 1 *]JU.tl4-r*L«:^<t ^3 jft(eHc*^< o 
A2JiH&a. bfl>S3e**i*aaftfl i A<R3S:«>ai&f4. 

[0 0 1 1] H4lC*5LvCI4. Hfta(Dft*8"l?j5*Lfc« 

h*vffi=-r6LT^*. u«a <t bfc (Dearth** 

hSo fit, B<DKttfi<D«a*<*/h&&«ttS£» 

[0012] 7f7?S2 5-e(4X-r^ 2 4 G>$£§k 

[0 0 1 3] ft. CZTM4. S©«*Hl05»aA<*/hi: 

l\, *fcA*H«a. b<D»JSj5£iffl«T— ***&-tlE 
fflSlCcfcy«fflLfc*<. #Jx.(£. 2-DOHHta . b £T 

[0014] /\ o: 3y-^it^a52-c?(4a£ti*tLfc*nc^ 

TlB«bA<0iae. (dx, d y ) mttOSt 
*««LfcBB«(=a&«fr*i:, Hl^a43£7>^ (xa, 
ya) I4I2lT(D*a (D ©IHfeb*©* (xb. y 
b) i:^t^o 

ya — dx) Xm 

■ya — dy)xm 



C = — r 



d x . D = -r 
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(1 ) 



*t>4o -Tft*>*>. WJCjiS^^ h;uco^^fil^ (a 

x, ay) k1'&b£+ *5C (2) C0cfc3(C/^>— ^ 

^is^l. tbAi-rSo 

a y (2) 

«3E«»»3e»3(4*(Dfcto(D«jE«»t*3Er«- 
[0 0 18] MIR«IEfi»kftSff3fi<t:i;mRK«ff 

* ^ — * ffi^fflJ 2 <Z>ta j« S ffll^T ^J^f 
So -T«:t>%. A*H«a(D*ffiaffl£a (1) Kttl* 
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[0 0 19] ^T-^^S 2|r£lvTffit£&I*]l=fc 

tlPai MPbz £-f& 0 A*IHftaa>ffi«»(=»L 
THttUDfflSSfrLV ».5B-riH*fll*P ek WPb 

k '(k=i-N) f?z> 0 ft, iimfii<7)-tf>?'J >y<* 
Ttat\ *fc. -y-v^iuiit lt/<7>- *icj=y» 

[0020] *i:±iaxf7?s 2 0)fflaiCcfcy3R*s * 

f (Pb) =Tbi xPb 2 +Tb2 xPb+Tb3 
[0022] Xf7?S 3(ZfcUT\ St (3) (7) f (P 

b) s*jar«fcto(D«»T bi . Tb 2 atfTb3'*« 

£=I [Pak - (Tbi x P bk 2 



*yBH»IE«»*#tf>4. H6(4PSWWIE«»«tb<D 

O-t^V^U-r— * P bk 0>ll9tttT?&y. flMSttlffea 
^ P ak U^fit$-fe^^)-r o Xf'^S 

[00 2 1 ] 35&5t£LT. CZTIiilHgLbCDljgHi^ 
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[0 0 2 3] BH»]E«»ftgffl3lcJ:y»:fflS*L*fiR 
ftl*. BB&ftfflU* 5lc#;Lt>*i£ 0 ft, CdT-lilU 
«b(DIffl*ttSHi«a(z-ft*1*i>fiSa*3R«)ruft<7> 
V. m&BOmmniEWM Tai , Ta2 &tfT 3 3 20 
(COUTliT ai =0. Ta2 =Ut/Ta3 = 0 <t & 

& o 

[0 0 2 4] ^ICX^^^S 4lZj3^TBH«jEIE«» 

a»tfb(D|ii*tt£KS|-rs 0 KIT. HH»jEe»»5 
(D»flFl=o^rKWr-6. BBJE«»5l=33ivci±. B 
MEM Tbi . TbzMTbs £ai=BMtb<D 

b ommfi o - 2 s 5^it (3) a)2*ia»ir«fcy 30 

f (0) ~f (2 5 5) l=K«-f4fcA(D^ — ^;U9 1 
0£±/rr&o BB«IEie»»4(coi*T*0«^&* 
CCTI4il«lafl)li*fllI±K»Lftl^t?. llll 
0-255^0-25 5izm&'t&7—yj\,tteZ>o 
[0025] ft. BBK»l=-3i*-Cl**^— IB«<Z>*^ 

x a = A' ■ x b + B' -yb + C 
ya=-B' -xb + A' - yb + D' 

A' =A/ (A2 + B 2) 

B' = -B/ (A2 + B2) 

C = (-AC + BD) / (A2 + B2) 

D' = (-BC-AD) / (A2 + B2) 



/M:t»Tbi . Tb2 MTba simj-r&o 

+ Tb2 x P bk +Tb3 ) ) 

(4) 

★fc. KBSUkt LTc^-ei*2*BBtt*ffli^fc*<J tea> 

[0026] M^DMfca^Jftffieicftivc* BBK 
Sfc»4. 5^*^^*LBB»jE**Lt=lii«atfA*ll«i 
1 o(D*ffl@i«3&<±filt**Li>o iUf&a&^JStffl 6 

xttm 8 ic^*tt;u=t u xaic^ot^^iu^ c 
£*l& 0 t^^s 5 1 -e*-r*jacH*cO)ia«fi«* 

iS^-T^o --Tli. H«««(DIftffiliA*lil«a.(Dffi 
«RS4t*l=ffLV H!9(7>^-C^LfcfligtCDcfc5[Cife 

[0 0 2 7] Bft b 0>E« £gi& a (D^IZ^f & IC 
I*3fe5t (5) (D7 7<>^IIft^Il^o SKft 
(D/\ e 7>-^^A' . B' . C . D' frStJsJLTlC 
^"ThC (5) ©SE«£fr5 z.£lc&£o 
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[0 0 2 8] £fc. $jatH«cO>±ttlilB*a<D±:ttffi 

aicS£»L-C*afttfcffi«0 5*»/h*l^<Dffi«fi. Tag 
l±H«aO)Tttffiaffii3«fcU : lI«bfl)*T«i. £TagO> 

[0 0 2 9] Xf^S5 2T*lt «#B<DfiiB£StB 
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S„ Xf7?S 5 3 "CI*. A-x*>^S 5 1 T'^Lf:^ 
[0 0 3 0] T.t-^^S 5 4T?I*. 01 0(C^-Tcfc3(Z 
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P= {p a x (dxa /W) ) 



* 

+ f 



(Pa) 



{1 . 0- (d 
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::t\ d x a 1 0{:i^-fcfc5lZ, O&^i L/>*& 
« * IE * T? CD SIgiT* & 6 o 

[0031] :%izm&b<DmmzMLximmzm$& 



a /W) 

(6) 

«rt-c. BBfc*««rti=*ft*<Diz»LTi*. 
10 J: y HtKffip ssfcsrr *>«, 



: fc « ti <D (z» l T U v-*-;uo> 
P= { P b x (dxb /w) ) + f ( P b ) 



{1 . 0- (d 
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::t\ d x bitM 1 oir^-r£5izo£:#@ L^bl 

$ &*ffi«tttt* t? (DEBT? fe £ o 

[0 0 3 2] ^(Dcfc 5 (3 LT#£>fc£-J#lIH£ c (DiU^li 
Hi 1©cfc5iz£<& 0 [HI 1 "Cft«-e5«L/=ffl»l*B« 

a , b ^%b*^btia*(o»]ar/)<ft*tL&i^fi«"e 

^5-11 (fc aHXi«) *><A3o 

[0 0 3 3] [11 2f±BI 1 1 <D "?o(>H{Z& If &WMi& 20 

U^;ua>!B«a(Dll»«"Cfc4. Ofc^@L<7) 

*<c*o ant,, BBk»««wrt<©B*fiizo^ri*lH 

b <D*- U v^;K7>i£jf?t{I 1 3 1 &tf Bflftftffi 5 
jE-T-^UI=«6L^«**lfclI*«1 3'2SS (7) (Z 
ttl^«.LfcB*<6l 3 3 £t£o-Cl*£o *6lz % BIEO 

K»««wno>««i±*- y s>-t-;KDia« b commm t & 

-So 30 

[0 0 3 4] ft, ±E©fiWCI±, l«ft«ftfija»6 
(i. oft^@Si*JiC>lz|Hfliaa>ffl«&tflI«b(Dli«(z 
#ltT#£&^£*Tofc*<. &*<DMfta>K*ffllZOl^* 
2W=Yx (dPavg /2 5 5) 

sl, Yi±iii«<B«w*iF-r. st (8) izasitsdP 
av g ttfiaffli=«(ti)ft^a)iii«<DiiH<z)asfc&fe 

U 1^25 5, M'h*C0<tft&o tot, u^<;u^ 
;ue*wj\£i\»^ia:2w*i/hS < 

[0 0 3 7] bit. 11 ©11*60)^18 tH«l-BI ii. 40 

&o xmmo&miz&tut, mmuo^^j^mizjtcx 

BHSC«ffla*<aJ6Ml=»S*HS<D-eH*lz5iB Lfc» 
[0 0 3 8] *(=**eSfl)«3(D*t6a)^IBl=Otx-CK 

fay* mmt$]E<Dj5&<Dfrmuz><Dx\ iaT*o>BB« 
1 ommo^m t mmzm& a a t/H« b ammani 
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(7) 

ffia-e^jffi$tLfciB«c(*cRT, >**izdaa* 

[0 0 3 5] aiZ*»B8<D«2<7)SJifi<D^ffilZOL^TK 

w^-&o *sjfio^«(=«fc*ii«^ia»iEfl>«jai*Bii 

Lfc« 1 <DSlfi(D^!B©«ia<!: ti^Tffc y . 

BBK«a«*5£» 3 & lifl*iSI*fiJt» 6 <D«ffi&tf 
»lfM>*f»«:«>©T?. BIT. ^CD»»OB^lzoL^rtt 
WTSo *SM6<0^«OBBft««*»:S»3rza3LxT 
(4. BBft«««2W£A*BHftaai;ba>ma»<DH 

smi^sizissrf & 0 m^mmmmmt^m^^ m^ 

3 (z^-^cfc 5 izfflMKDUHft a StfiUfti b <DtUSifi££^ 
lZ-yisZfjl^r—$ P ak &1/P bk ££j£-r&*><. -CO 
<t £<D¥*DfiI<Z>^d Pavg £P]B#IZ 

3fctf>£ 0 *#>fz¥£){tCD^d Pavg £lHft&ftfrj£ffi6 

[0 0 3 6] ffl«Jfc»£j8«6l=jSl^T(*. ^btlfcd 
P av6 *Slz*5C(z < fcyBBSC*««2wS»^-r5o 

(8) 

m^xit. &*zw>zfj[s'r— $ &mi&$:&\zm^2.m 

ftlz«fc yiS«bOffiBSIB*slz-ife*-a:Sfctf)fl)K» 
B8ft«±jaLTBBSE«SffoT*5y. tot, H«ffi 
(DK«I*IB«ba>^Sfi L -rS : fcG)"C&«>o 

[0 0 3 9] c*L!Z»LT*S6t6cDli^8S"rfl*. ^&^C0imj 
^(Dlii^fll £ ft» L TBBMIE £^*t-T * t © T? fe S B 

Bn%n6(c^-rH«*ytt«B»t*aLr. bbka 

s 1 ©n^ff^ <b fH]^(cu^ b <nmmm$:m& a ic- 

[0 0 4 0] BBfttt8P5(£. BF{ftb(7)lJigffi$SlzK 
«H»l=«fcyBB*K«-r*. t'Jvt;« 
bCDHmft^Pb. *aH»(z«feyK»**LfcliiRfll* 
f (Pb) i: LT)UT©se9IZcfcy^&£||frf £o 



(6) 



Pb' = (Pb+f (Pb) ] /2 

p a ' =p a - [ {f (Pb) -Pb] 
(ML, P aitm&aO)**) v^-;U(7)ll*tt1?&6- 
[0 0 4 2] ±IBaBHSE&0ffEft£|g| 1 4ic^-f 0 El 
1 4 IC^-f ^^Sfef (Pb) ir^'J v^JKD 

©*ttP b bO* 7 -by h f (Pb) -Pb0)1/2^ 

iM=#^*4ctic*y«ni»iEtff5. s-Pgisasi&sp 

[0 0 4 3] JSIT. « 1 <DSU60)^®fcl^«l=IH«*» 
$jaffl6lZfeL^$jaH«<D»Sii^*<fffe*L€>o Bi 

[0044] 

[»W<DJ»*] I2l±ttMLfc«fc5l^ »3»*1, 6(7)* 
[0 0 4 5] *fc. «jR«2©«W(C«fc*ll*. fi-ABft 

^<D*BBK»£fr5<D-t?. daaicR-rseBsisffiat- 

[0 0 4 6] »3R«4G>*WI=«J:*Ui* A*BB« 
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(9) 

[0041] BBMrtMicfci^n*. ^4 0 

1 (=cfcypSB*«*fr.5o 

/2] ( 1 0) 

[BBOffiW&KWl] 

[Hi] -3S8Jfi(Dfl^ffllwJi*|iI«^jaS 
[El 2] stBjSttfflff^ffliaiT^^UXAS^-r^P — 
[B3] *H6ji5attST?a>T->^U— hOttjy ttJ u*a* 

[m 4] »j£jjaaaiTa)a5R««<Dtts*as^riiijai 

ElT?fo6 0 

[El 5] BB«jE(DfflS7VU^UXA£^-r^o — 

[Be] +*->^ji>T r — $(Dm& : £mTf$f\±mT*$>&o 

[El 7] BBK*»«)Kft-r— ^K©«iaB"^&*o 
[El 8] H«««&J3£»<0*a«7;u^UXA*^-r7n 

9] H«S-flt*ftSK?B-r««iaBI"C&4o 
[B1 0] Bflk^A^£RK-r««fiKI9 H eft«. 

[El 1 1 ] ^Ilj^-^J^^-rPj^El^fc^o 
[B1 2] fi-fltli«G>-fi>J*^«FttBI-t?a&So 

[bi 3] m2(»mifc<DteWz&&v>zJji^r—$om 

[B1 4] »3©St6©^JBlc«fcSHB«»Sttffl'rs 

[01 5] K3(D»Jfi<0J^JBI=«fc*lHft«'flcSK^"rS 
45ttElT?&6<, 

[Bi e] dj«^*ffi*<o»«tt^s^"r«iaia-efc 
[Eii 7] A*®*6<o-«s^-r«i/aia"T?a&So 

[Ell 8] tt*C7)^«lj^(D-01J^^-rt8/aillT*fe^o 
[»#<DKW1 

1 »i£jftattiff 

2 ^«3g» 

3 ?%mmiEm§k>k'fcm 

4, 5 HBftftffi 
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